Papers with TDM triples
Efficient Performance Tracking: Leveraging Large Language Models for Automated Construction of Scientific Leaderboards (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing leaderboards are incomplete and some contain incorrect information. |
| Approach: | They propose a manually-curated Scientific Leaderboard dataset that overcomes these problems . they propose three experimental settings where TDM triples are fully defined, partially defined, or undefined . |
| Outcome: | The proposed system overcomes the shortcomings of existing leaderboard datasets . it can be used to evaluate and compare scientific methods, but it requires manual labor . |